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Method for Determining a Displacement Vector in Video/Image Processing 

The present invention relates to a method for determining a displacement vector in video/image processing. 

In video/image processing, displacement vectors or motion vectors function by a sufficiently known ap- 
proach to define a change in position of an object or image area from a first position within a first image to a second 
position within a second image. 

The two images here can be recorded temporally sequentially, thereby graphically representing a movement 
of the object or image area in a displayed image segment over time. In such cases, the motion vector serves, for 
example, to interpolate one or more intermediate images which reproduce the position of the object at one or more 
instants between the recording of the first and second images, for example, in the case of 50Hz/100Hz video conver- 
sion or when generating so-called "artificial time expansions." 

The two images can also be recorded simultaneously from a first and second camera position, where the 
displacement vector to be determined serves to generate an intermediate image which shows the object from a an- 
other virtual cameral position which is located at a position different from the first and second camera positions. 

Figure 1 shows two images Bl, B2, which can have been recorded in temporal succession or from different 
camera positions, having a first image area 1 at a first position P 1 within a first image B 1 , and a second image area 2 
at a second position P2 within the second image B2. For the sake of simplifying the representation, image areas 1 , 2 
are represented as squares, the midpoints of which are identified by positions PI, P2 of the image areas. The image 
areas may, of course, have any desired shape. 

As Figure 1 illustrates, second image area 2 in second image B2 results from a displacement of first image 
area 1 of first image Bl by a displacement vector vec. This displacement can be a function of time when the two 
images Bl, B2 are recorded in succession and an object representing first image area 1 moves within the examined 
image segment from position PI at the instant first image Bl was recorded to position 2 at the instant second image 
B2 was recorded. This displacement of the two image areas 1, 2 within the displayed image segment can also be the 
result of the fact that the two images Bl, B2 were recorded at the same instant but from different viewing angles. 

One basic approach, known for determining this type of displacement vector for a given image area or ob- 
ject, is to divide the image into individual image areas and supply test vectors, each of which represents a possible 
displacement vector for the individual image areas. Using these test vectors, image comparisons are performed by 
which image information, for example, luminance values or chrominance values for the individual pixels of an ex- 
amined image area in the first image, is compared with image information values for a second image area in the 
second image, where one selection vector each is used to displace the position of the second image area in the sec- 
ond image relative to the position of the first image area in the first image. Out of the test vectors here, that/those 
vectors are selected as the so-called selection vector(s) which provide(s) the "best" comparison result, for which, in 
other words, the best match is determined between the first and second image areas. 
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The quality of this method is a function of the selection vectors chosen since it is, of course, impossible to 
perform an image comparison for all the possible displacement vectors due to the need to keep the already high 
computational effort within certain limits. It is thus a fundamental goal of these methods to reduce the number of 
required image comparisons without accepting degradation of the result in the determination of the at least one se- 
lection vector. 

A known method for reducing the effort/complexity is to utilize certain prior information in the selection of 
test vectors for a given image area, which information has been obtained, for example, in previous search steps for 
the given image area, or in search steps for an adjacent image area. This prior information results in a group of so- 
called prediction vectors from which the test vectors are generated or selected. These prediction vectors, which were 
obtained using search steps for adjacent image areas or using previous search steps for the image areas examined, 
can be accepted as the test vector for the area of interest, and/or the test vectors can be generated from these predic- 
tion vectors by changing their length and/or direction according to a predetermined or random scheme, whereby in 
this last-named case the prediction vectors can change from search step to search step. 

The selection vectors determined from the test vectors can be utilized as new prediction vectors during the 
subsequent search steps. 

In order to illustrate this method, Figure 2 provides a schematic view of a vector search system which de- 
termines displacement vectors for individual image areas and which incorporates prediction vectors to determine a 
possible displacement vector, the prediction vectors containing results from previous search steps for the same im- 
age area, or results from search steps for adjacent image areas. The system comprises a test vector determination 
unit 10 to which a set of prediction vectors are supplied and which provides a set of test vectors from these predic- 
tion vectors. This provision of test vectors can be implemented by passing on unchanged some or all of the predic- 
tion vectors as test vectors. In addition, it is possible to modify some or all the prediction vectors according to a 
fixed or random scheme in order thereby to generate the test vectors. 

The test vectors are employed in an image comparison unit 20, connected on the output side of the test 
vector determination unit 10, to perform image comparisons for the individual image areas, where, with reference to 
Figure 1, one image area 1 from first image Bl is always compared with an image area 2 from second image B2, 
while from second image B2 for each comparison that second image area is selected, the geometry of which matches 
the geometry of first image area 1 and which area is displaced relative to first image area 1 of first image 1 by one of 
the selection vectors. 

The results determined for the individual comparisons are supplied to a selection unit 30 which, based on 
the comparison results, selects at least one selection vector for which the best comparison result was determined out 
of the group of test vectors. This at least one vector selected based on the comparison results represents the actual 
displacement vector, or at least the most likely displacement vector, which maps first image area 1 from first image 
Bl onto second image area 2 in second image B2. In the determination of the comparison result, it is possible to 
evaluate the test vectors differently as a function of how they were generated. For example, it is possible in the im- 
age comparison to "penalize" the prediction vectors or test vectors determined based on the image comparisons for 
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previous images, that is, to grade them lower than test vectors that were determined for adjacent image areas within 
the same image. 

In the known method presented here, the selection vectors are always a function of the prediction vectors. 
However, an appropriate utilization of these prediction vectors requires that the displacement of adjacent image 
areas, or the displacement of the image area of interest, does not undergo significant variations over time, since it 
must be ensured that the selection vectors determined from the prediction vectors also contain the actual displace- 
ment vector. Otherwise a considerable expansion in the number of selection vectors is required. 

The goal of this invention is therefore to provide an improved method for determining in video/image proc- 
essing at least one selection vector which is in particular capable of taking into account rapid changes in the dis- 
placement vectors. 

This goal is achieved by a method based on the features of Claim 1. Advantageous embodiments of the in- 
vention are discussed in the subordinate claims. 

In the method according to the invention to determine a selection vector which indicates a displacement of 
an image area from a first position in a first image to a second position in a second image, a set of prediction vectors 
and a set of test vectors are provided. The prediction vectors here can be obtained by conventional methods to gen- 
erate prediction vectors, for example, by utilizing information from a search of displacement vectors for adjacent 
image areas or from the previous search of displacement vectors for the image area of interest. 

Using selected test vectors from the set of test vectors, an image comparison is performed in order to supply 
an image comparison result for each of these selected test vectors. In addition, the selected test vectors and at least 
one of the prediction vectors are compared in order to provide at least one test vector comparison result for each of 
the selected test vectors. Subsequently, the image comparison result determined for the selected test vector and the at 
least one vector comparison result determined for a selected test vector are linked in order to provide at least one 
quality characteristic for each of the selected test vectors. A ranking order is determined for these quality character- 
istics, wherein at least one test vector is selected as the displacement vector based on the ranking order determined. 

The test vectors are preset and cover different possible displacements of the image area of interest within a 
specified image raster. In the method according to the invention, the information contained in the prediction vectors 
is taken into account by the fact that, in addition to the image comparison result obtained from the test vector, the 
distance of the test vector from the prediction vector is determined when selecting one of the test vectors as the dis- 
placement vector. 

The image comparison result for the selected test vector can be determined using conventional methods by 
comparing the image information of the pixels from a first image area in the first image with image information 
values of the pixels from a second image area in the second image, where the position of the first image area rela- 
tive to the position of the second image area is displaced by the test vector in question. If these two image areas are 
superimposed, then assuming geometrically identical image areas, for each pixel of the first image area located at a 
given position in this image area, one pixel of the second image area is associated which is located at the corre- 
sponding position in the second image area. The determination of the comparison result can comprise the compari- 
son of the image information values of all the pixels in the two image areas, or the comparison of the image infor- 
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mation values of selected representative pixels, where the individual pixel comparison results are summed to obtain 
the image comparison result. A pixel comparison result for a pixel from the first image area and an associated pixel 
from the second image area can be obtained, for example, by 

- generating the difference in the two image information values; 

- determining the absolute value of the difference for the two image information values; 

- forming the square of the difference in the two image information values. 

Any number of other mathematical methods which provide a measure for the match or differences between 
two image areas is, of course, possible. 

In addition, it is possible to incorporate into the image comparison additional pixels which are located out- 
side the compared image areas, or to incorporate additional pixels which are generated, for example, by interpolating 
the given pixels of the image areas examined. 

The image comparison is performed by supplying a numerical value for each comparison of two image 
areas, which value is, for example, increasingly smaller the greater is the match between the compared image areas. 

In order to determine the vector comparison result for a test vector as a function of a prediction vector, for 
example, the absolute value or the square of a difference vector for these two vectors is determined. As a result, for 
each comparison of a test vector with a prediction vector, a numerical value is obtained which is increasingly 
smaller the less the test vector and the prediction vector deviate from each other. 

In the determination of this vector comparison result, it is possible to take into account how the prediction 
vector was determined. For example, the prediction vector can be a displacement vector which was determined for 
adjacent image areas of the image area of interest, or the prediction vector can be a displacement vector which was 
determined for the image area of interest or image areas adjacent thereto in a preceding image. In determining the 
vector comparison result, it is possible, for example, to "penalize" a prediction vector which was determined based 
on a preceding image, that is, to output a worse vector comparison result for this vector than for an identical vector 
which was determined based on an adjacent image area within the same image. 

The penalization can be effected by multiplying the determined comparison result by a multiplication fac- 
tor, this multiplication factor being externally adjustable and, for example, determining the manner of generating the 
prediction vector. Instead of multiplication by a penalization-dependent factor, it is also possible to add a value 
dependent on the desired degree of penalization to the determined comparison result. 

If one takes the locational or temporal origin of a prediction vector as a function of the image segment for 
which the image comparison is implemented as the criterion for penalization, then the penalization relates to all the 
comparison results of this prediction vector with the test vectors. In addition to the locational or temporal origin of 
the prediction vector, it is also possible to utilize still other criteria for a penalization. For example, there is the pos- 
sibility of utilizing the absolute length of a test vector as the penalization criterion, where test vectors having a large 
absolute length are penalized if it is assumed, for example, that motion sequences occurring in the images proceed 
slowly. 

In addition, there is the possibility of incorporating the structure of the image into the determination of a 
suitable selection vector. If, for example, self-similar structures, that is, monotone areas, are present, it may be use- 



mif096 

I-0147/I-0148 

5 

ful to obtain selection vectors that deviate as little as possible from the previously prediction vectors determined. If 
the result of the vector comparison is a numerical value which becomes larger the more strongly a test vector devi- 
ates from a prediction vector, then this goal can be achieved by weighting each vector comparison result with a 
value greater than one, with the result that for test vectors that deviate strongly from the prediction vectors, viewed 
in absolute terms, especially "bad" vector comparison results enter into the quality consideration. Self-similar struc- 
tures can be determined by an image comparison - normally a block-by-block image comparison - within the im- 
age. 

In order to generate the quality characteristic of a test vector in regard to a prediction vector, the image 
comparison result determined for the test vector and the test vector comparison result are linked to each other, the 
linking being effected such that, given an identical image comparison result, the quality characteristic improves the 
less the test vector and the selected prediction vector differ. Assuming that only the "best" test vectors are selected 
from the ranking order determined, those test vectors will thus be preferred which differ little from the prediction 
vectors. This consideration of the origin of a prediction vector in the image comparison can be effected, for example, 
by providing the comparison result with an offset, the value of which is a function of the origin of the given predic- 
tion vector. 

The quality characteristic can be determined by a weighted addition of the numerical value obtained from 
the image comparison result and of the value obtained from the vector comparison result, where, for one test vector, 
multiple quality characteristics are determined, the number of which corresponds to the number of prediction vectors 
with which the selected test vector is compared. 

In one embodiment, the vector comparisons are performed between the selected test vectors and all the 
prediction vectors in order to obtain, for each of the selected test vectors, a number of vector comparison results 
corresponding to the number of prediction vectors. Preferably, a ranking order of the vector comparison results is 
determined and only the "best" vector comparison result is utilized to generate the quality characteristic, such that 
for each test vector precisely one quality characteristic is determined. 

In another embodiment, for each prediction vector the best test vector for this prediction vector is deter- 
mined, where, for example, that/those test vector(s) is/are selected as the selection vector which has/have been de- 
termined most frequently as the best test vector for the selection vectors. It is also possible here to select a set of test 
vectors for each prediction vector. 

Preferably, all the test vectors are selected, that is, image comparisons are performed for all the test vectors, 
where additionally for all the test vectors vector comparisons can be performed with all the prediction vectors. 

The selection of the at least one test vector as the selection vector is preferably effected iteratively by first 
providing a set of fixed selection vectors from which the "best" test vector(s) is/are selected based on the ranking 
order determined using the image comparison results and the vector comparison results. Subsequently in the next 
iteration step, a second group of test vectors is determined from these best test vectors, where the test vectors of this 
second group are generated from the previously selected best test vectors. 

Generation of these test vectors of the second group is effected, for example, by adding in each case prede- 
termined modification vectors to the previously selected test vectors of the first set. One or more of the test vectors 
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from the second group can also be generated here for one of the selected test vectors. The modification vectors are 
preferably selected such that the differences 1 between these test vectors produced by adding the modification vectors 
to one of the previously selected test vectors are smaller than the variations of the individual test vectors from the 
first group. 

Another ranking order is generated for the test vectors of the second group based on the image comparison 
results and the vector comparison results, which ranking order is employed to select at least one test vector used to 
generate a selection vector, or is employed to select one or more of the test vectors from which another group of test 
vectors is generated for another iteration step using modification vectors. 

In one embodiment, a ranking order of test vectors is determined for each prediction vector, and the respec- 
tive best test vector for each of the prediction vectors is used for the subsequent iteration step. After the last iteration 
step, it is possible to select from the set of "best" test vectors that test vector as the selection vector to which the best 
quality characteristic is assigned. 

When determining the vector comparison result, it is of course also possible in the case of iterative methods 
to take into account the origin of the prediction vector. 

In addition, it is possible to divide the prediction vectors into groups by their origin - for example, into 
prediction vectors that were determined based on the previous image for adjacent image areas relative to the image 
area of interest, prediction vectors that were determined based on a previous image for the image area of interest, 
and prediction vectors that were determined based on the current image for adjacent image areas relative to the im- 
age area of interest. For each of these groups, the best test vector(s) is/are determined during each iteration step for 
the subsequent iteration step. Upon completion of the iteration procedure, in addition to the determination of a selec- 
tion vector based on the ranking order of the best test vectors, it is possible to store that best test vector determined 
for a specific group as a new prediction vector. 

Preferably, the modification vectors comprise the zero vector, such that the test vectors selected at the end 
of an iteration step, from which based on the modification vectors the set of test vectors for the next iteration step is 
generated, are contained within this set of test vectors for the next iteration step. 

Preferably, the individual modification vectors match in terms of their direction for the individual iteration 
steps, but become smaller in terms of their absolute value from iteration step to iteration step such that with each 
iteration step test vectors are generated for which the difference is smaller. 

In addition, it is possible to select the modification vectors as a function of the previously determined qual- 
ity criterion. If, for example, for each selection vector that best test vector is determined, from which one or more 
vectors nevertheless provide a worse quality criterion, then in this embodiment these test vectors are subjected, for 
example, to greater modifications since it must be assumed that smaller modifications would not produce any sig- 
nificant improvement. Conversely, test vectors that provide a good result are modified only slightly or not at all 
during the subsequent step. 

Viewed in its entirety, this type of iterative method is based on a set of test vectors that is generated from an 
original set of test vectors by means of all the possible combinations with the modification vectors, where, however, 

1 Translators note: Original German has "difference" [singular]. 
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during the individual iteration steps test vectors are repeatedly rejected in order to keep the computational effort 
within limits. 

The method according to the invention for determining a selection vector can be applied in a method to 
determine a set of selection vectors wherein selection vectors are determined using the method explained above, 
where as many test vectors are selected as selection vectors are required based on the determined ranking order of 
the quality characteristic. 

The method can also serve as an expansion of a known method in which one or more prediction vectors are 
employed as selection vectors, and which is improved by employing at least one test vector which was selected 
based on the ranking order of quality characteristics as the selection vector. 

In both methods, the selection vectors can function as prediction vectors for the next vector search step of 
the image area examined, where the selection vectors can be accepted unchanged as prediction vectors, or can be 
changed based on a preset or random scheme to generate the new prediction vectors. In this last-presented method in 
which prediction vectors and test vectors are employed as selection vectors, preferably those selection vectors from 
the previous step which provide the worst image comparison result are no longer utilized as new prediction vectors 
but are instead replaced by test vectors determined based on the ranking order. 

The invention will now be explained in further detail with reference to the drawings. 

Figure 1 is a schematic view of a first and second image, each having image areas which relate to each 
other through a displacement vector; 

Figure 2 shows a system for supplying a set of selection vectors using prediction vectors, as known from 
the prior art; 

Figure 3 is a flowchart for a method according to the invention for supplying at least one selection vector 
using a set of test vectors and a set of prediction vectors; 

Figure 4 shows tables comprising the image comparison results and vector comparison results which are 
linked to quality characteristics for the selected test vectors; 

Figure 5 shows a quality characteristic matrix; 

Figure 6 is a flowchart for another embodiment of the method according to the invention wherein the at 
least one selection vector is determined iteratively from the set of test vectors; 

Figure 7 is a schematic view of a possible procedure for an iterative method to provide a set of test vectors 
using a selected test vector and using modification vectors as shown in Figure 6; 

In the figures, unless otherwise indicated, identical reference notations denote identical components or pro- 
cedural steps. 

Figure 3 uses a flowchart to illustrate an embodiment of the method according to the invention for deter- 
mining at least one selection vector which, with reference to the example of Figure 1, represents a possible dis- 
placement vector for displacing the first image area 1 from the first position PI in first image Bl to a second posi- 
tion P2 in the second image B2. As was explained at the outset, these selection vectors serve to perform image com- 
parisons between image areas in first image Bl and second image B2, the compared image areas being displaced 
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relative to each other by one each of the selection vectors. The selection vector accepted is the actual or most likely 
displacement vector which provides the "best" image comparison result. 

In the method according to the invention for supplying at least one selection vector, a set of prediction vec- 
tors 101 is supplied, Figure 3 illustrating as examples four such prediction vectors VI, V2, V3, V4. These prediction 
vectors V1-V4 can be supplied using conventional methods to determine prediction vectors. These methods com- 
prise, for example, supplying prediction vectors for a given image area based on already determined displacement 
vectors for adjacent image areas of the given image area. For example, it is possible, as illustrated in Figure 1, to 
determine the prediction vectors for image area 1 using displacement vectors that were determined for adjacent 
image areas 3, 4, 5 of the first image area. In addition, it is possible to determine prediction vectors for a given im- 
age area using selection vectors that were determined for this image area 1 during the previous vector search steps. 

Also according to the invention, a set of test vectors 102 is supplied, 3 such test vectors Tl, T2, T3 being 
shown by way of example in Figure 3. 

From this set of test vectors 102, at least one test vector is selected, although preferably all the test vectors 
T1-T3 are selected, and in a step 103 these test vectors are used to perform image comparisons in order to supply an 
image comparison result for each of the selected test vectors T1-T3, which result is identified in Figure 3 as B(Tn), 
where Tn represents any selected test vector T1-T3. The image comparison comprises the comparison of a first 
image area 1 in first image B 1 with a second image area 2 in second image B2, where a position P2 of second image 
area B2 is displaced relative to the position PI of first image area 1 by that one of the selected test vectors for which 
the image comparison result is determined. 

With reference to Figure 1 , the displacement vector vec for each image comparison is replaced by another 
of the selected test vectors T1-T3. For the purpose of the image comparison, image areas constructed from a number 
of pixels are compared by comparing image information values, for example luminance values or chrominance val- 
ues of two pixels each located in first image area 1 and in second image area 2 at the corresponding pixel positions, 
where the individual comparison results are summed. In order to supply the image comparisons, for example the 
squares of all the differences between the image information values of the pixels of first image area 1 and the pixels 
of second image area 2 are summed such that an image comparison result is obtained, the numerical value of which 
becomes smaller the greater is the match between two examined image areas 1,2, and which in the extreme case is 
zero when the two examined image areas are identical, that is, when the two image areas match pixel for pixel. 

The number of image comparison results B(Tn) provided by the image comparison step 103 corresponds to 
the number of selected test vectors T1-T3, of which preferably all are selected. 

In a procedural step 104, the selected test vectors T1-T3 are compared with at least one of prediction vec- 
tors V1-V4 in order to provide vector comparison results V(Tn, Vm). Here, V(Tn, Vm) denotes a comparison result 
determined by a comparison of prediction vector Vm with test vector Tn, where Tn represents any of the selected 
test vectors T1-T3, while Vm represents any of the selected prediction vectors V1-V4. Preferably, all the prediction 
vectors V1-V4 are utilized for a comparison with all the test vectors T1-T3, thus producing a number of vector 
comparison results V(Tn, Vm) which corresponds to the product of the number of test vectors and the number of the 
prediction vectors. 
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In the determination of the vector comparison result, it is possible in particular to take into account the 
origin of the prediction vector, and, by taking into account a selectable offset in the comparison result, for example, 
to give those prediction vectors that were determined based on a previous image a lower evaluation than those pre- 
diction vectors that were determined for adjacent image areas based on the current image. 

The comparison of a test vector Tn with a prediction vector Vm comprises, for example, determining the 
square of the absolute value of the difference vector between test vector Tn and prediction vector Vm. 

The vector comparison results V(Tn, Vm) and the image comparison results B(Tn) are linked in a proce- 
dural step 105 to quality characteristics G(Tn, Vm). G(Tn, Vm) in Figure 3 denotes a quality characteristic obtained 
by linking the image comparison result B(Tn) to the vector comparison result V(Tn, Vm). The linking operator is 
represented in Figure 6 by the symbol "o". 

The linkage of the vector comparison result V(.) and B(.) can comprise various types of linkage, depending 
on the manner in which image comparison results V(.) and B(.) were obtained. Using the assumption that image 
comparison result B(.) represents a numerical value which becomes smaller the greater are the matches between the 
examined image areas, and that the vector comparison result V(.) represents a numerical value, the value of which 
becomes smaller the smaller is the difference between the examined test vector and the examined prediction vector, 
the linkage of the image comparison result B(.) and vector comparison result V(.) can be implemented, for example, 
by weighted addition, where the applicable relation is: 

G(Tn, Vm) = k T • B Tn + k v ■ V(Tn, Vm). 

The sum of the weighting factors k T + k v here is one. How strongly the vector comparison result V(.) and 
the image comparison result B(.) are actually weighted is a function of the specific case of application, although 
neither of the two weighting factors k T , k v is zero. 

Figure 4 shows a table 113, generated in procedural step 103, presenting image comparison results B(T1) 
through B(T3), as well as a table, determined in procedural step 104, presenting vector comparison results V(T1, 
VI) through V(T3, V4) which are linked in procedural step 105 to generate a table with quality characteristics G(T1, 
VI) through G(T3, V4). 

In a procedural step 106, a ranking order is determined by sorting, and at least the test vector for which the 
best quality characteristic has been determined is selected as the selection vector. The selection vector(s) selected 
is/are identified in Figure 3 by Ti. 

Based on the assumption, by way of example, that the numerical values of the image comparison results 
B(.) become smaller the greater is the match between the examined image areas, and that the vector comparison 
results V(.) become smaller the smaller are the differences between an examined test vector and an examined predic- 
tion vector, and that the vector comparison results V(.) and image comparison results B(.) are summed, it follows 
that the best quality characteristic is the quality characteristic with the smallest numerical value. 

In a modification of the above-described method, in procedural step 104 each of the selected test vectors 
T1-T3 is compared with each of the selected prediction vectors VI -V4 and vector comparison results V(Tn, Vm) are 
supplied, whereas in procedural step 105 only the best vector comparison result of a test vector is linked with the 
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associated image comparison result B( ). As a result, Table 1 14 is reduced to a number of values which corresponds 
to the number of selected test vectors. 

In addition, it is possible for each prediction vector V1-V4 to determine that test vector Tl which has the 
best quality criterion so that a number of test vectors is determined which corresponds to the number of test vectors. 

Figure 5 illustrates this procedure using a matrix in which test vectors T1-T3 and selection vectors VI -V4 
are plotted, where the individual matrix elements represent, by way of example, one quality characteristic each asso- 
ciated with one test vector and one prediction vector. Based on the assumption that the quality characteristic is de- 
termined such that a specific test vector receives a better rating the smaller is its quality characteristic, in the exam- 
ple test vector Tl would be selected as the best vector for prediction vector VI, test vector Tl would be selected as 
the best vector for prediction vector V2, test vector T3 would be selected as the best vector for prediction vector V3, 
and test vector T2 would be selected as the best vector for prediction vector V4. 

From these best test vectors, one test vector or multiple test vectors can then be selected, where during this 
selection the quality criterion determined for the given test vector, and/or the frequency at which a test vector was 
selected as the best test vector for the prediction vectors, can be taken into account. 

In addition, the test vector determined for a selection vector can be stored as the new prediction vector, 
where the possibility exists to classify the selection vectors based on their origin and storing the test vectors obtained 
accordingly in an associated group. 

In the illustration of Figure 3, it is assumed that a set of test vectors 102 is supplied from which, by per- 
forming image comparisons and employing prediction vectors, at least one test vector Ti is selected which can be 
used as the selection vector. 

In a modification of the procedure shown in Figure 3, the flowchart of which is shown in Figure 6, at least 
one selection vector is determined by an iterative method. 

As Figure 6 shows, in this method too a set of test vectors T1-T3 is supplied, and from this set of test vec- 
tors T1-T3 at least one test vector Ti is selected using a procedure already explained for Figures 3 and 4. In contrast 
to the method of Figure 3, however, this test vector Ti is not outputted as the selection vector immediately after the 
first run of the method; instead this at least one test vector Ti serves in a procedural step 107 as the basis for generat- 
ing an additional set of test vectors that are identified, by way of example, as Til, Ti2, Ti3, Ti4, where the already 
described procedure is implemented once again with this new set of test vectors in the manner described above. In 
order to illustrate more clearly the iterative character of this method as shown in Figure 6, Figure 6 presents two 
switches SI, S2, where switch S2 is found in the position shown on the left at the start of the procedure in order to 
process the original set 102 of test vectors Tl, T2, T3 in procedural step 103, and where switch S2 is found in the 

s 

position shown on the right at the start of the procedure in order to supply the at least one selected test vector Ti to 
procedural step 107 to generate a new set 1 12 of test vectors Til - Ti4. During the subsequent iteration steps, the 
first switch SI is found in the position shown on the right in order to supply the test vectors of the set of test vectors 
generated from the selected test vectors Ti to procedural step 103. At the end of the procedure, the second switch is 



Translators note: Presumably, "prediction vectors" was intended here. 
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moved to the position shown on the left in order to output the at least one selected test vector Ti as the selection 
vector. 

Figure 7 illustrates a possible design for procedural step 107 in which the new set of test vectors 1 12 is 
supplied from at least one selected test vector Ti. Figure 7 shows a selected test vector Ti in a Cartesian coordinate 
system wherein a set of four additional test vectors Til, Ti2, Ti3, Ti4 are generated from this test vector Ti by vecto- 
rial addition of four modification vectors M1-M4. Preferably, one of the modification vectors is a zero vector, with 
the result that the selected test vector Ti is also accepted into the set of new test vectors 112. The modification vec- 
tors shown, M1-M4, can be represented in Cartesian coordinates as (± a,0) and (0, ± a), where a represents the abso- 
lute value of modification vectors M1-M4. It is, of course, also possible to employ more than four modification 
vectors, so as to thereby generate from one selected test vector Ti more than four test vectors, or in the event the 
zero vector is used as a modification vector, more than five test vectors from one selected test vector Ti. Additional 
modification vectors include, for example, (± 0.5 • a • V2, ± 0.5 • a • V2). 

Preferably, the absolute value a of the modification vectors decreases with each iteration step, thereby gen- 
erating one set of test vectors with each iteration step from one selected test vector Ti, which test vectors decreas- 
ingly differ from selected test vector Ti. 

With the described iterative method, it is also possible to take into account the origin of the prediction vec- 
tor in the determination of the vector comparison result. 

In addition, it is possible during each iteration step to determine the respective best test vector and use it for 
the subsequent iteration step. After the last iteration step, the respective best test vector determined for each predic- 
tion vector can be stored as a new prediction vector. 

The modification of a test vector selected for the next iteration step is preferably implemented as a function 
of the quality characteristic determined during the previous iteration step. As a result, test vectors having a good 
quality characteristic are modified to a lesser degree than are test vectors having bad quality characteristics. This can 
be achieved, for example, by setting the absolute value of the modification vector as a function of the previously 
determined quality characteristic. 

The method according to the invention for determining a selection vector using a set of test vectors and a 
set of prediction vectors is completely capable of determining selection vectors, wherein, for example, a set of test 
vectors is supplied which contains more test vectors than are required as selection vectors, and wherein by using the 
method so determined in each case the best test vectors can be selected as the selection vectors. The method accord- 
ing to the invention can also be used in connection with conventional methods in which selection vectors are deter- 
mined using prediction vectors. At the same time, it is possible to employ, in addition to the prediction vectors, at 
least one test vector as a selection vector which was determined using the method according to the invention. 

The selection vectors determined for a given image area can be utilized for subsequent search steps to de- 
termine the prediction vectors. 



